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Abstract 

This paper presents the joint impact of the numbers of antennas, source-to-channel bandwidth ratio and spatial 
correlation on the optimum expected end-to-end distortion in an outage-free MIMO system. In particular, based on 
an analytical expression valid for any SNR, a closed-form expression of the optimum asymptotic expected end-to-end 
distortion valid for high SNR is derived. It is comprised of the optimum distortion exponent and the multiplicative 
optimum distortion factor. Demonstrated by the simulation results, the analysis on the joint impact of the optimum 
distortion exponent and the optimum distortion factor explains the behavior of the optimum expected end-to-end 
distortion varying with the numbers of antennas, source-to-channel bandwidth ratio and spatial correlation. It is 
also proved that as the correlation tends to zero, the optimum asymptotic expected end-to-end distortion in the 
setting of correlated channel approaches that in the setting of uncorrelated channel. The results in this paper could 
be performance objectives for analog-source transmission systems. To some extend, they are instructive for system 
design. 

Index Terms 

MIMO, end-to-end distortion 

I. Introduction 

A. Background 

I It is well-known that the functional diagram and the basic elements of a digital communication system 
can be illustrated by Fig{T][3J. The source can be either analog (continuous-amplitude) or digital (discrete- 
amplitude). Whichever is the source, there is always a tradeoff between the efficiency and the reliability. 
For transmitting a digital sequence, the tradeoff would be between the spectral efficiency (bit/s/Hz) [41 
and the error probability. For transmitting a bandlimited analog source, under the assumption of a band- 
limited white Gaussian source, the tradeoff would be between the source-to-channel bandwidth ratio 
Ws/Wc (SCBR) [5] and the mean squared error (MSB) |l6l, 0, i.e., the end-to-end distortion. 

A point of distinction between digital-source transmission and analog-source transmission is: in digital- 
source transmission, if the spectral efficiency (bit/s/Hz) is below the upper bound (channel capacity) subject 
to channel state and the transmitter knows the instantaneous channel state information (CSI) perfectly, 
the error probability would go to zero; whereas, in analog-source transmission, no matter how good the 
channel condition and the system are, the end-to-end distortion is non- vanishing, because the entropy of 
a continuous-amplitude source is infinite and thus the exact recovery of an analog source requires infinite 
channel capacity [[6l-[|9l. 

Regarding the end-to-end distortion, in IfTOl , [fTTTl . Ziv and Zakai investigated the decay of MSB with 
SNR for the analog-source transmission over a noisy single-input single-output (SISO) channel without 
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Fig. 1. Basic elements of a digital communication system 



any channel knowledge on the transmitter side (CSIT). In lfT2l . [[T3l . Laneman et al. used the distortion 
exponent in the asymptotic expected distortion 

p-S-oo log p 

related to SCBR as a metric to compare different source-channel coding approaches for parallel channels. 
Note that p denotes the SNR and ED denotes the expected end-to-end distortion over all possible channel 
states. Choudhury and Gibson presented the relations between the end-to-end distortion and the outage 
capacity for AWGN channels [fT41 . Zoffoli et al. studied the characteristics of the distortions in MIMO 
systems with different strategies, with and without CSIT fTS], fT6^. 

In [fT7l-[fT9l. for tandem source-channel coding systems, assuming optimal block quantization and 
SNR-dependent rate-adaptive transmission as in [20], HoUiday and Goldsmith investigated the expected 
end-to-end distortion for uncorrected block-fading MEMO channels based on the results in [|20l - [|22l . 
They gave the following upper bound on the total expected distortion (MSE) 

where rj is the SCBR, r is the multiplexing gain (the source rate scales like r log p), A^^ is the number 
of transmit antennas and A^,. is the number of receive antennas. Considering the asymptotic high SNR 
regime, they proposed that the multiplexing gain r should satisfy 

Ke^ = {Nr-r){N,-r) = - + o{l) (3) 

where A*pp is the optimum distortion exponent for tandem source-channel coding systems. The explicit 
expression of A*gp is given by Theorem 2 in ll23l . 



A* M = ^l^d*{j-l)-{j-l)d*ij)] 
^^^^'^ 2 + r^{d*{j-l)-d*{j)) ' ' 



2(j - 1) 2j 



(4) 



for j = 1, . . . , A^min with A^min = vam{Nt, Nj.} and d*{j) = (Nt— j){Nr — j). Note that a factor 2 appears 
here and there because the source is real whereas the channel is complex. 

In [|23]| . [|24l . assuming an uncorrelated block-fading MIMO channel, perfect CSIT and joint source- 
channel coding, Caire and Narayanan derived the optimum distortion exponent 

A*(r7)= ^min|-,2i-l + |A/'(-A/'^|| (5) 
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Fig. 2. Impact of distortion factor 

which is larger than A*pp. Concurrently, the same result as Q was also provided by Gunduz and Erkip 

m, m. 

Caire-Narayanan's and Gunduz-Erkip's derivations are extensions to the outage probability analysis in 
[|20l . They jointly considered the MIMO-channel mutual information in bits per channel use (bpcu) [|27l 



X = lo£ 



(6) 



where H is the A^^ x A^^ complex channel matrix with Nt inputs and Nr outputs , the rate-distortion 
function for a A/'(0, 1) source [i9| 

D{R,) = 2-2«» (7) 
where Rs is the source rate, and Shannon's rate-capacity inequality for outage-free transmission f7] 

Rs < Rc- (8) 



B. Problem statement 

Nevertheless, there is something more than the distortion exponent in the expected end-to-end distortion. 
Intuitively, for high SNR, the form of the asymptotic optimum expected end-to-end distortion can be written 
as 

ED:,y = /x*(p)p-^* (9) 

where the multiplicative optimum distortion factor iJi*{p) varies less than exponentially: 

lim !5ii^M = 0. (10) 

p^-oo log p 

For an analog-source transmission system, its performance at a high SNR could be measured via the 
asymptotic expected end-to-end distortion 

EDasy = P(P)P-^ (11) 

where the distortion exponent A and the distortion factor p(p) could be obtained analytically. 
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Obviously, we cannot say that a system achieves the optimum asymptotic expected distortion ED*^^^ if 
what it achieves is only the optimum distortion exponent A*. Also, we cannot say that in the regime of 
practical high SNR, the scheme with a larger distortion exponent must perform better than the other. As 
illustrated by Figj2l in the regime of practical high SNR, the effect of the distortion factor must be taken 
into consideration. In other words, for practical cases, studying only the optimum distortion exponent 
is insufficient and giving the closed-form expression of ED^^^ is more meaningful. Using ED^^^ as an 
objective, via analyzing both A* and iJi*{p), it is possible to design an analog-source transmission system 
performing better than the existing systems in the regime of practical high SNR. 

For deriving ED*^^, if we could obtain the analytical expression of ED* valid for any SNR, then it 
would be easy to find out the optimum distortion factor yU*(p) and the optimum distortion exponent A*. 



C. Outline 

In this paper, for the cases of spatially uncorrected channel and correlated channel, we give an analytical 
expression of the optimum expected end-to-end distortion ED* in an outage-free MIMO system valid for 
any SNR, based on which the optimum asymptotic expected end-to-end distortion ED*^^ is derived. The 
simulation results agree with our analysis with the derived results on the joint impact of the numbers of 
antennas, source-to-channel bandwidth ratio and spatial correlation. 

The remainder of this paper is organized as follows. The system model is given in Section [III In 
Section Hill the preliminaries such as the mathematical definitions, properties and lemmas are presented 
for deriving the main results in Section |IVl Section |V] is dedicated to the simulation results, numerical 
analysis, and discussions. Finally, the contributions of this paper are concluded in Section |Vll with our 
perspectives on future work. 

Throughout the paper, vectors and matrices are denoted by bold characters, | A| denotes the determinant 
of matrix A and {ajj}j .,=i tv is an x matrix with entries a^, i,j = 1, A^. Also, E{-} denotes 
expectation and, in particular, E^{-} denotes expectation over the random variable x. The superscript ^ 
denotes conjugate transpose. (a)„ denotes T(a + n)/T(a). log refers to the logarithm with base 2. 



II. MIMO System Model 

Assume that a continuous-time white Gaussian source s(t) of bandwidth Ws and source power P, is 
to be transmitted over a flat block-fading MIMO channel of bandwidth Wc and the system is working on 
"short" frames due to strict time delay constraint, i.e., no time diversity can be exploited. The transmission 
system is supposed to be free of outage, e.g., the transmitter knows the instantaneous channel capacity by 
scalar feedback and does joint source-channel coding. Let s{t) denote the recovered source at the receiver. 

Suppose a K-to-(Nt x T) joint source-channel encoder is employed at the transmitter [|23l , which maps 
the source block s G onto channel codewords X G C^*^^. Herein, the source block s is composed 
of K source samples, Nt is the number of transmit antennas, and T is the number of channel uses for 
transmitting one block. The corresponding source-channel decoder is a mapping C^*^^^ — )■ that maps 
the channel output Y = {yi, . . . ,yT} into an approximation s'. Assuming the continuous-time source 
s{t) is sampled by a Nyquist sampler, 2Ws samples per second, and the bandlimited MIMO channel is 
used as a discrete-time channel at 2Wc channel uses per second [9, pp. 247-250], we have the SCBR 

At the t^^ channel use, the output of the discrete-time flat block-fading MIMO channel with Nt inputs 
and Nr outputs is 

yt = Hxi + ni, t = l,...,T (13) 

where G C^' is the transmitted signal satisfying the long-term power constraint E[xf^X(] = P, H G 
QNrxNt ^Yie channel matrix whose entries ~ CJ\f{0, 1), G C^"^ is the additive white noise matrix 
whose entries utA ~ CJ\f{0, a^). Note that the SNR per receive antenna is p = P/cr'^- 
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TABLE I 

'^{a, c; x) FOR SMALL x, REAL C 



c 




c > 1 


x'-''r{c-l)/r{a) + o{x'-'') 


c = l 


-[r{a)r'logx + o(\logx\) 


c < 1 


r(i-c)/r(a-c + i) + o(i) 



In the case of uncorrelated channel, the hij's are independent to each other. In the case of spatially 
correlated channel, we have the correlation matrix S = E(HH^) which is assumed to be a full-rank 
matrix with distinct eigenvalues cr = {cti, cr2, ■ ■ ■ , 0-^^.^}, < ai < a2 < ■ ■ ■ < <JNmin- '■^^^ ^e seen that 
in the case of uncorrelated channel, S is an identity matrix with ai = a2 = ■ ■ ■ = un^.^ = 1- 

III. Mathematical Preliminaries 

The mathematical properties, definitions and lemmas in this section will be used in the derivations for 
the main results. 



A. Mathematical properties and definitions 

We shall use the integral of an exponential function 

/•oo 

/ e-P^x«-^(l + axY^'dx = a-T(g)^(g, q + 1- u,p/a), 
Jo 

3?{g} > 0, ^{p} > 0, ^{a} > 0. 
as introduced in [28, pp.365]. This involves the confluent hypergeometric function 

f oo 

which satisfies (with y = ^) 

X— ^ + (c-x)- ay = y). (16) 

dx^ dx 

Bateman has given a thorough analysis on '^{a,c;x) [|29l pp. 257-261]. In particular, he obtained the 
expressions on '^{a,c]x) for small x as Table IJ shows. In Appendix lAl we also state some of his more 
general results for any x, which we will use for the analysis in the case of spatially correlated MEMO 
channel. 



(14) 



^(a,c;x) = -i- / e-^*r-^(l + t)^-"-Mt, 3f?{a} > (15) 



B. Mathematical lemmas 

The proofs of the mathematical lemmas below can be found in Appendices IBUHI 
Lemma 1: Define an m x m full-rank matrix W(x) whose entry is of the form CjjX™"^"'*^-'^^, 

Cij ^ 0, x,a E M+, 1 ^ i, j ^ m. Then 

, log|W(x)| ^ 

lim -2^ ^ = V minia, 2i}. (17) 

x^o hgx ~( 

Lemma 2: Define an mxm Hankel matrix W(x) whose (i, j)**^ entry is of the form Cj+jX*"'"-', Q+j ^ 0, 
X e R"*", I ^ i, j ^ m. Then, each summand in the determinant of W(x) has the same degree m(m + 1) 
over X. 

Lemma 3: Define an m x m Hankel matrix W whose {i,jy^ entry is T(a + j — l),l^i,j^m, 
aeR. Then 

m 

|W| = JJr(A;)r(a + A;). (18) 

k=l 
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Lemma 4: Define an m x m Hankel matrix W wliose {i, entry is T{a + i + j — l)T(b — i— j + 1) 
where l^i,j^m, m^2 and a, 6 G M. Then 

|w| = r(a + i)r(6 - i)r'"-^(a + b) 

Al ^ ^ ^ ^ ^Y{a + b-k + l)T{b-k + l) 

Lemma 5: Define an m x m Toeplitz matrix W whose {i,jy^ entry is T{a + i — j), 1 ^ i, j ^ m, 
a G M. Then 

m 

m(m — 1) -| — r 

|W| = (-1)^^11 r(A;)r(a + A;- m). (20) 

k=l 

Lemma 6: Define 

^(n)=n'^-/(n), (22) 

subject to a G M^, m,n G Z+, n > m, and n — m + 1 > a. Then both /(n) and (^(n) are monotonically 
decreasing. 

Lemma 7: Let (a)„, denote r(a + n)/T{a), a eM., n E Z"*". Then 

(a+l)„ = (-l)"(-a-n),. (23) 

IV. Main Results 

A. Uncorrelated MIMO channel 

Theorem 1 (Optimum Expected Distortion over an Uncorrelated MIMO Channel): Assume a continuous- 
time white Gaussian source s{t) of bandwidth Ws and power Pg to be transmitted over an uncorrelated 
block-fading MIMO channel of bandwidth Wc- The optimum expected end-to-end distortion is 

Psmri)\ 

]Xk=i r(A^max -k + i)r(iv^i„ -k + l) 

where r] = Ws/Wc (SCBR), A^^m = mm{Nt,Nr}, A^^ax = max{Nt,Nr}, and U{r]) is an A^^^m x A^^i^ 
Hankel matrix whose {i,jy^ entry is 

|- J r{di,)^ U^, d,, + 1 - j (25) 

where dij = i+ j + |A^i - A^^l - 1, 1 < i,j < A^min, and ^(a, 6;x) is the ^ function (see (291 pp. 257-261]). 
This theorem is valid for any SNR. 

Proof: The source rate of the source s{t) is [|6l 



ed:^m = — , .v:l... — (24) 



Rs = W Jog ^ (26) 

where D is the distortion (MSB). 

Under the assumption that the transmitter only knows the instantaneous channel capacity R^, the 
covariance matrix of the transmitted vector x at the transmitter is taken to be a scaled identity matrix 
P/NflNf As stated in [|27l . the mutual information per MIMO channel use is 



X(x; y) = log 



H 



(27) 
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And as stated in [|9l pp. 248-250], a channel of bandwidth Wc can be represented by samples taken l/2Wc 
seconds apart, i.e., the channel is used at 2Wc channel uses per second as a time-discrete channel. Hence, 
the channel capacity (bit/second) is 



R, = 2W,I = 2WJog 

Substituting (|28l) into Shannon's rate-capacity inequality 

Rs < Rc 

we get the optimum end-to-end distortion 



I;v. + ^HH 



N, 



Thereby, the optimum expected end-to-end distortion is 



ED*{r]) = P,Eh 



U + l-HHt 



(28) 



(29) 



(30) 



(31) 



whose form is analogous to the moment generating function of capacity in [|30l . By the mathematical 
results given by Chiani et al. [|301 for the expectation over an uncorrected MIMO Gaussian channel H, 
we have 

EDl,M = PsK\V{r,)\ (32) 



where U(77) is an A^min x A^min Hankel matrix with (i, j) entry given by 



and 



K 



r(iVmax -k + l)r(iV^in - A; + 1) ' 



dx 



By the integral solution (fT4l) . (l33l) can be written in the analytic form 



This concludes the proof of the theorem. 



2 

T{dij)'^ [ dij, dij + 1 - -; — ^ 



(33) 
(34) 

(35) 



Theorem [T] tells us that the analytical expression of ED^^^ is a polynomial in p ^. Therefore, for high 
SNR, the optimum asymptotic expected end-to-end distortion is of the form 

^^:.y,unc = PlnMp-""-^"^ (36) 

where A*^j,(?7) is the optimum distortion exponent satisfying 

A:„(„) = _ ,ta l^i^M (37) 

p-^oo log p 

and yLi*^(, is the accompanying optimum distortion factor satisfying 

lim ^^^fM. = 0. (38) 

p^oo log p 
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Ki{P,t,m,n) 



r(l3-n+m-2k+2)T{l3-n+m-2k+l) f ^ 1 ■ 

r(n-m + l)^(^^tpi), t = l; 

1, t = 0. 



(44) 



, N ; nl-ir(A;)r(n-m-/3 + fc), t > 0; 



1, t = 0. 



Since ED*^^^ is concave in the log-log scale and monotonically decreasing with SNR and ED^^y ^^j, is the 
tangent of the curve ED"^^^ at the point where SNR is infinitely high, we see that the asymptotic tangent 
line i?D*gy ynj. is always above the curve ED*^^^, i.e., EDl^^^^^^ is always worse than ED^^^. 
The closed-form expressions of A*„^(r7) and p^ndv) given as follows. 

Theorem 2 (Optimum Distortion Exponent over an Uncorrelated MIMO Channel): The optimum dis- 
tortion exponent is 

KnM = 5^ min -, 2A: - 1 + \Nt - iV,,| L (39) 

A;=l '-'^ ^ 



Proof: This optimum distortion exponent appeared already in [|23ll . n25n . However, a different proof 
is provided here. 

Consider Uij{r]) in Theorem [TJ When p is large, Nt/ p is small. We thus refer to Table IJ and see that, 
for high SNR, My (77) approaches eij{ri)p~'^'^^'^^ with 



Aijir]) = min I ^, z + J - 1 + |iVi - AT.I I 



(40) 



and 

lim i^f^ = 0. (41) 

p^oo log p 

Straightforwardly, in the regime of high SNR, the asymptotic form of |U(r7)| can be represented by 

|E(r/)|p-^"-('') with 

lim = 0. (42) 

p^oo log p 

By Lemma [H we obtain that 

A:nc(^) = 5^ min -, 2fc - 1 + \Nt - iV,| L (43) 
fc=i '^^ ^ 

This concludes the proof of this theorem. ■ 
Theorem 3 (Optimum Distortion Factor over an Uncorrelated MIMO Channel): Define two four-tuple 

functions t, m, n) and Kh{l3, t, m, n) for /3 G M"*" and t G {0, Z+} as in (|44|) and (l45l) . The optimum 

distortion factor pl^^^iv) given as follows: 
1. For 2/?7 G {0,\Nt — Nr\ + l), referred to as the high SCBR regime (HSCBR), the optimum distortion 



factor is 



^* l^hi^jj} -^mini -^min; -^max) 

Uk=r r(iVmax -k + i)r(iv^i, - A; + 1) ■ 



Pl^^iv) = PsNt^-- ^M^..^^,./' ^^ttttt: (46) 

It decreases monotonically with A^^ 
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2. For 2/?7 G {Nf + Nj. — !, +00), referred to as the low SCBR regime (LSCBR), the optimum distortion 
factor is 



( jj ' -^mirn -^minj -^max) 



n£r r(iVmax -k + l)r(iV^i, - A; + 1) 



(47) 



3. For 2/r/ G [|A^t - A^^l + 1, A^t + iV^ - 1], referred to as the moderate SCBR regime (MSCBR), the 
optimum distortion factor is 



where / 



^ + l-|Aft-Af,| 



( f . ' .^min , A'max ) th ( I - 2Z , Af^in - « , A'min , A'max ) 

nf=r r(Af^ax-fc+i)r(iv^i„-fc+i) ' 



mod ^ + l-\Nt-Nr\,2}^0; 

Ki{l,l-l,N^in,N„,^^)Kh{^-2l,N^in-l,N^in,Nm3.^) 



(48) 



mod {^ + 1- |iV,-iV,|,2} = 



Proof: See Appendix HI 

B. Spatially correlated MIMO channel 

Theorem 4 (Optimum Expected Distortion over a Correlated MIMO Channel): The optimum expected 
end-to-end distortion in a system over a spatially correlated MIMO channel is 

^'.|G(r,)| 



where G{ri) is an A^min x ^min matrix whose (i, j)*'^ entry given by 



(49) 



(50) 



dj = \Nt - Nr\ + j. cr = {cTi, (T2, ■ ■ ■ , (^N^i^} with < cxi < a2 < ■ ■ ■ < (Tn^i,, denoting the ordered 
eigenvalues of the correlation matrix S. 

Proof: Following the proof of Theorem [TJ by the mathematical results given by Chiani et al. in [|30l 
for a spatially correlated H, we have 



EDUV) = PsK^\G{v)\ 
where G{r]) is an N^^^ x ^min matrix with entry given by 



'0 



and 



|V2(o-)|n£rr(Ar^a.-A; + l) 
where V2(cr) is a Vandermonde matrix given by 



with the Vandermonde matrix Vi(x) defined as 

/ 1 1 



Vi(x) 



3^1 



X2 



\ ^1 



M . —A M . —A 

^ * mm rr> mm -■- 



•• 1 \ 



N ■ —1 
N / 



(51) 

(52) 
(53) 

(54) 



(55) 
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In terms of the property of a Vandermonde matrix [|3T1l . the determinant of V2(cr) 

|V2(^)|= n i-^j' + ^i') (56) 

l<m<n<Nmin 

n (^m(^n^{(^n-(ym) (57) 



\<m<n<Nmin 



J-J^i-iv.„i„ n K-^-) (58) 

fc = l l<m<n<Nm.in 

N ■ 

^min 

nar^-ivi(cT)i. (59) 



k=l 

Thereby, 

1 

^ n£r 4''*-"^^'^^r(iv_ - A: + 1) ni<.<„<^_(^n - ■ ^^^^ 

In terms of the integral solution (fT4l) . (|52|) can be written in the analytic form 



^?..(^) = (^^ J r(^i,)vl/ rf, + 1 - -; ^ J . (61) 

This concludes the proof of this theorem. ■ 
Theorem 5 (Optimum Distortion Exponent over a Correlated MIMO Channel): The optimum distortion 
exponent A*^^. in the case of spatially correlated MIMO channel is the same as the optimum distortion 
exponent A*jjj, in the case of uncorrelated MIMO channel, that is. 



cor 
unc 

iVmi 



= KnM = E ^^^i^ {-'2^ -l + \Nt- Nr\j (62) 

Proof: See Appendix HI ■ 
Theorem 6 (Optimum Distortion Factor over a Correlated MIMO Channel): The optimum distortion fac- 
tor /icorl??) is given as follows. 

1. For 2/?7 e (0, \Nt- Nr\ + l) (HSCBR), the optimum distortion factor is 

PIoAv) =W^k^ Knc(^)- (63) 

k=l 

2. For 2/?7 G [Nt + Nr-l, +oo) (LSCBR), the optimum distortion factor is 

N • 

' mm 

P:oAri)= W^-k'^-'-plrM- (64) 
fc=i 

3. For 2/r/ G [\Nt - A^^l + 1, A^* + A^,. - 1] (MSCBR), the optimum distortion factor is 



-l)^|V3(-) 



T-fAfmin ^lA't-Afrl+l T-r ( rr - rr \ 

\.\.k=l "k IIl<m<n<Afmin'^ " 

-^min~^ (^) 



(65) 
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where / = |^j±L_!Z^i_J^j and each entry of V3(cr) is 

— min{j — 1, — — dj} 

= " . (66) 

Proof: See Appendix [Kl ■ 
Theorem 7 (Convergence): 

lim/icor(^) = Knc(^)- (67) 

Proof: See Appendix O ■ 



V. Numerical Analysis and Discussion 

In this section, the examples in various settings are provided. The simulation and numerical results 
illustrate the foregoing results. 



A. An example in the HSCBR regime, uncorrelated MIMO channel 

Figl3] shows the numerical and simulation results on the optimum expected end-to-end distortions in 
the outage-free MIMO systems over uncorrelated block-fading MIMO channels in the high SCBR regime 
and at the high SNR, p = 30 dB. The number of antennas on one side (either the transmitter side or the 
receiver side) is fixed to five and the number of antennas on the other side is varying. ED"^^^ denotes 
the ED^^^ corresponding to (|3T1) . evaluated by 10 000 realizations of H. 

From Fig j3(b)| , we see that ED^^^ monotonically decreases with the number of antennas on one 
side, which agrees with our intuition. There is an excellent agreement between ED^^^ and ED"^^^ 
which indicates that, in the setting when SNR is 30 dB, the behavior of ED^^^ at a high SNR can be 
explaine d by studying ED*^^ .^^^. 

In Fig j3(a)[ in terms of Theorem [2l the optimum distortion exponent A*^^^ increases with A^min and then 
remains constant when A^min stops increasing, though the number of antennas on one side is increasing. In 
Fig j3(b)[ in terms of Theorem [3l /i*jjc is monotonically decreasing with A^max- Therefore, when A^min < 5, 
ED^^^ is decreasing because A*^^ is increasing; although the optimum distortion factor /i*^^, is increasing, 
the increase of A*jj^ dominates the tendency of ED"^^^ since the SNR is high. When the A^min is fixed 
to 5, ED^^^ is decreasing because /i*^^^, is decreasing, though A*^^, keeps constant. In summary, we see 
that, for high SNR, the decrease of -E-Dunc with the number of antennas is due to either the increase of 
the optimum distortion exponent or the decrease of the optimum distortion factor. 

Moreover, from FigH it is seen that the commutation between the number of transmit antennas and the 
number of receive antennas impacts ED'^^^. This impact comes from the effect on the optimum distortion 
factor indicated by the expressions in Theorem [3] and shown in Fig j3(b)[ between a couple of 

commutative antenna allocation schemes, (At = A^min,Ar = A/'max) and (At = A^max? = A^min), the 
former scheme whose number of transmit antennas is the smaller between the two numbers of antennas 
suffers less distortion than the other. This is reasonable since under a certain total transmit power constraint, 
the scheme with fewer transmit antennas achieves higher average transmit power per transmit antenna. 



B. An example in the MSCBR regime, uncorrelated MIMO channel 

In [ITSl . [[T6l , assuming a AA(0, 1) source and the system bandwidth is normalized to unity, Zoffoli et 
al. studied the characteristics of the distortions in 2 x 2 MIMO systems with different space-time coding 
strategies. In particular, in [fT6l . assuming the transmitter knows the instantaneous channel capacity and 
thus the system is free of outage, they compared the strategies with respect to expected distortion and the 
cumulative density function of distortion. They exhibited that, among REP (repetition), ALM (Alamouti) 
and SM (spatial multiplexing) strategies, the expected distortion of the ALM strategy is very close to that 
of the SM strategy. 
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Number of antennas on one side Number of antennas on one side 



(a) (b) 
Fig. 3. Uncorrelated channel, one of {Nt,Nr) is fixed to 5, = 4, high SCBR. 




5 10 15 20 25 30 5 10 15 20 25 30 

SNR (dB) SNR (dB) 



(a) Log-lin scale (b) Log-log scale 

Fig. 4. ALM vs. SM, uncorrelated channel, Nt = Nr = 2, rj = 1, moderate SCBR. 



As Zoffoli et al. derived lfT6l . the expected distortion of tlie ALM strategy is 



2 p[(p-4)p-4]+4e^(3p + 2)r(0,^: 



-"ALM 



(68) 



and tlie expected distortion of tlie SM strategy is 



16 



ED 



SM 



p-(p + 2)epr(0, 



+ 



p - 2epr(0, 1) p{p + 2) - 4(p + l)epr(0, 



(69) 

p" p" 

Note tliat r(a, x) denotes tlie upper incomplete gamma function, r(a, x) = t^-'^e'^dt. As given in 
[fT6l . Fig j4(a)| shows the difference between the expected distortions of the two strategies in log-lin scale. 
In log-lin scale, the expected distortion of the ALM strategy is very close to that of the SM strategy in 
the high SNR regime, i.e., ED^lu — EDsm is very small. 
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O Simulated 
Analytic 
Asymptotic 



5 10 15 20 25 30 

SNR (dB) 

Fig. 5. Uncorrelated channel, Nt = 1, Nr = 2, rj = 0.99, low SCBR 

According to the assumption in (W\, the SCBR of the systems is one, i.e., i] = 1. As Nt = Nr = 2, it 
is seen that, for the systems considered, 

\Nt-Nr\ + l< - <Nt + Nr-l (70) 
V 

and thus the systems are in the moderate SCBR regime. From the description of SM strategy, it is seen 
that the expected distortion achieved by SM strategy is the optimum expected distortion for a 2 x 2 MIMO 
system with rj = 1, i.e., EDsm = ED*^^^. Regarding the asymptotic characteristics, from (1681) and (|69l) . 
we have 

2 _2 

-E^-Dasy,ALM = gP , (71) 

-E'-Dasy.sM = -E-D*sy,unc = 8p"^- (72) 

The ratio EDxhu/ ED^m is an alternative metric revealing the difference between ED alm and EDsm, 
illustrated by Fig |4(b)| in log-log scale. We see that in the high SNR regime, although ED alm approaches 
EDsM in the linear scale as Fig j4(a)| shows, the ratio EDalm/ ED^m becomes larger and larger as Fig j4(b)| 
shows. It can also be seen that the expected distortions of the ALM and SM strategies are determined by 
their asymptotic expressions when the SNR's are greater than 13 dB and 20 dB respectively. 

C. An example in the LSCBR regime, uncorrelated MIMO channel 

Fig. [5] presents an example when Nt = 1, Nr = 2 and r] = 0.99. The red circles represent the results 
of Monte Carlo simulations which are carried out by generating 10 000 realizations of H and evaluating 
(|3TI) . The blue dashed line represents E'D*^^ y^^. The green line represents the analytical expression of 
ED'l^^ in Theorem [T] It can be seen that the simulated results agree well with our analytical results. 
The gap between the asymptotic tangent line and the curve of ED^^^ implies that, for the systems in 
the LSCBR regime, more terms in the polynomial of ED*^^^ are to be analyzed, which is much more 
complicated than analyzing the asymptotic expression. It is a subject for future research. 

D. Examples in HSCBR & LSCBR regimes, spatially correlated MIMO channel 

The analytical framework we derived is general and valid for all correlated cases with distinct (unre- 
peated) eigenvalues of the correlation matrix S. To give an example, we consider a well-known correlation 
model as in ff301 : the exponential correlation with S = {rl*"-'!}^ .,=i ... and r G (0, 1) [32 J. 
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10 15 
SNR (dB) 



(a) iVt = 4, iVr = 2, 7? = 10, high SCBR (b) Nt = 2, Nr ^ 2, r] ^ 0.6657, low SCBR 

Fig. 6. Expected distortions of uncorrelated and correlated channels 



Fig j6] illustrates the optimum expected end-to-end distortion ED* on a power-one white Gaussian source 
transmitted in different correlation scenarios. Red circles represent the results of Monte Carlo simulations 
which are carried out by generating 10 000 realizations of H and evaluating (|3TI) . Green lines represent 
the analytical expressions of ED*^^. in Theorem |4] and ED'^^^ in Theorem 1. Blue dashed lines represent 
the optimum asymptotic expected end-to-end distortion ED*^^. 

i^^is. = l^rC^' (73) 



In Fig j6(a)[ we see that there is an agreement between ED* and ED*^^ in the high SNR regime 



Corresponding to Theorem [5] and Theorem |6l in the high SNR regime, due to the same optimum SNR 
distortion exponent, the optimum distortions of the systems in different correlation scenarios have the same 
descendent slopes; the difference comes from different distortion factors which depend on the correlation 
coefficients. The optimum distortion is increasing with r and the line of the uncorrelated case (r = 0) is 
the lowest. For reaching the same optimum expected distortion, there is about 8 dB difference of SNR 
between the cases of r = 0.99 and r = 0. This agrees with our intuition that spatial correlation decreases 
channel capacity. 

The impact of correlation can also be seen in Fig |6(b)| by the example in the low SCBR regime. There 
are gaps between the asymptotic lines and the optimum expected distortions for the same reason as for 
the example in Section IV-CI 



VL Conclusion and Future Work 

A. Conclusion 

In this paper, considering transmitting a white Gaussian source s(t) over a MIMO channel in an outage- 
free system, we have derived the analytical expression of the optimum expected end-to-end distortion 
valid for any SNR (see Theorem [T] and Theorem U) and the closed-form asymptotic expression of the 
optimum asymptotic expected end-to-end distortion (see Theorem [2l Theorem [3l Theorem [5] and Theorem 
[6l) comprised of the optimum distortion exponent and the multiplicative optimum distortion factor. By the 
results on the optimum asymptotic expected end-to-end distortion, we have analyzed the joint impact of the 
numbers of antennas, source-to-channel bandwidth ratio (SCBR) and spatial correlation on the optimum 
expected end-to-end distortion. Straightforwardly, our results are bounds for outage-bearing systems and 
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could be the performance objectives for analog-source transmission systems. To some extend, they are 
instructive for system design. 



B. Future work 

• As we have shown in FigjSjand Fig |6(b)[ for a system in the low SCBR regime, there is an apparent 
gap between EDJ^^ and ED* in the practical high SNR regime. The reason that the gap exists is 
the effect of the other terms in the polynomial expansion of ED*. Therefore, if the closed-form 
expression with more terms in the polynomial expansion of ED* could be derived, the analysis on 
the behavior of ED* would be more precise. 

• Let us provide an insight into Theorem |2l Define a non-negative integer m as 



m 



N ■ - 



i; + l-\Nt-Nr\ 



0<^<|iV,-iV,| + l 



l<-<Nt + Nr-l: 



(74) 



0, 

Then, (|39| ) can be written in the form 

A*iv) 



> Nt + Nr - 1. 



{Nt - m){Nr - m) + 



2m 



(75) 



which looks analogous to the formula of the Diversity-Multiplexing Tradeoff (DMT) 11201 and to the 
expression of the distortion exponent ^ in tandem source-channel coding systems [fT9ll . Note that 
(1751) has nothing to do with outage since the instantaneous channel capacity is assumed to be known 
at the transmitter. This intriguing similarity induces us to conjecture that there may be a hidden 
connection to be explored. 
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Appendix A 
Some Properties of \E'(a, c; x) 

If c is not an integer. 



T(l-c) 

— $(a,c;x) 

(76) 



^{a, c; x) = — —TT^ia, c; x 

T(a — c + 1 



+ \, x^~'^'|)(a -c+l,2-c;x) 
i [a) 

where $(a,c;a;) is another confluent hypergeometric function, 

$(a,c;x) = f;j^^. (77) 
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Note that (a)„ = r(a + n)/r{a). 
• if c is a positive integer, 



(-1) 



n-l 



n\T(a — n) 



$(a, n + l;x) logx 



f \ r 

( ("^(^ + ^) " "^(1 + ^) " + n + r)) ^ 

(n-l)!!^^ (a-n), x-'" 

Z^t; — — "- = 0,1,2,, 



(78) 



The last sum is to be omitted if n = 0. 

-^[a, c; X) = x^'^'-^ia - c + 1, 2 - c; x). (79) 
Thus, when c is a non-positive integer, we can obtain the form of \l/(a, c; x) from (1781 ) and (1791) , 

(-1)- 



^1/(0, c; a;) = 



(l-c)!r(a) 



^{a + 1 - c,2 - c;x)x "logx 



r=0 



(2 - C)r 



(80) 



V'(2-c + r))- 



r(l — c) (a)r a;'^ 



r(a + 1 - c) ^ (c)r r! 

Appendix B 
Proof of Lemma [H 

We will prove this lemma recursively. 

Define p{n) = mm{a,n}, subject to a G and n G Z+. If mi — m2 = rii — ^2, nii > rii, and 
1712 > n2, then 

p(mi) - p(m2) < p{ni) - p{n2). 



In the case that m = 2, by definition, 

W2(X) 

Then 



CiiXP(2) Ci2XP(3) 
C2lXP(3) C22XP(^) 



By dSB, 

Consequently, when m = 2, 



|W2(x)| = cnC22a;^(')+^(') - cucl,x'''^'\ 



p(2) +p(4) < 2p(3). 
log|W2(x) 



(81) 

(82) 

(83) 
(84) 



lim 



x-j-O logx 



p(2)+p(4) 



min{a, 2i}. 



(85) 



Suppose when m = /c — 1, A; G Z+ fl [3, +00), 



lim 



log|Wfc_i(x) 
logx 



1=1 



min{a, 2i}. 



(86) 



When m = k, W^fx) can be written as 



where the column vector 



bfc(x) 



Hence, in terms of Schur determinant formula [|3T1l . 

log|W,(x)| ^ log [|W,_i(x)||W*„,(x)|] 

x^Q logX i^-^-O logX 

^ log|W,._i(x)| ^ logdetW*_,(x) 

a;->-0 logX a;->-0 logX 

where ^\_^[x) is the Schur complement of Wfc_i(x), 
Since Wfc_i(x)W^_^^(x) = I, is of the form 



p(2fc-2) 
-l,fc-l-^ / 



Consequently, 



lim 

a; -5-0 



log [bnx)w,-ii(x)b 



logx 



(a) 



min{p(2A; - 1) - p(A;) + y{k + 1), p(2A; - 1) - p(A; + 1) + p(A; + 2) 
p(2A; - 1) -p(2A; - 2) +p(2A; - 1)} 

p(2A; - 1) - J9(2A; - 2) + p(2A; - 1) 
> p(2A;) 

where both steps (a) and (6) follow the inequality (fSTI) . Therefore, by (|89| ) and (|90| ). 



logdetW(x) A 
lim ; = > mm-^a,2zf, 

x^O logX 



which concludes this proof. 



Appendix C 
Proof of Lemma [2] 

Each summand in |W(x)|, which is a product of the entries Wij^, . . . ,Wmjm^ be written as 



X 



n 



fc=l 



where the numbers {ji, j2, Jm} is a permutation of {l,2,...,m}. Then, each summand has the 
degree m(m + 1), which concludes the proof. 
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Appendix D 
Proof of Lemma [3] 

By definition, 

/ r(a + l) ••• r(a + m) 
W= : |. (95) 

\ r(a + m) ■■■ r(a + 2m-l) 

For calculating the determinant of W, we do Gaussian elimination by elementary row operations from 
bottom to top for obtaining the equivalent upper triangular L [|33l . Below-diagonal entries are eliminated 
from the first column to the last column. 

Let W/ denote the matrix after the below-diagonal entries of the l^^ column are eliminated. Then the 
(i, j)*^ entry of Wi subject to i > j > / is of the form 

w^,j = e^j r{a + i + j- l-l). (96) 

Hence, after below-diagonal entries of the (/ — 1)**^ column are eliminated, for the entries subject to i > I 
and j = I, 

wi-i^i^i^i = 9i_i^i_i^i T{a + i-l), (97) 
wi.i,^,i = ei^^,i,iT{a + t). (98) 

Consequently, for eliminating the (i, ly^ multiplied entry of Wi_i to obtain W;, the factor for the row 
operation in the Gaussian elimination on the i^^ row 

ci, = --^^^^{a + z-l). (99) 

That is, wi^ij is obtained as follows: 

Wi^ij = Wi-i^ij + Ci^i 



9 

(a + i+j - l-l) - 9i-i,i-i,j (a + i-l) 



xT{a + i + j - I -1). 
Comparing the RHS of the above equation to (l96l) . we get 



(100) 



Oi,ij = ei_i,ij (a + t+j-l-l)- ei_,^,.,j (a + z - 1). (101) 

Before doing any operation on W, 6'o,j,j = 1. Then, by (|101l) . we obtain Oi^ij = j — 1 and 92,ij = 
r(j)/r(j- 2). Supposing 

r(?) 

9iii = (102) 

then by (IIOII) we have 

Oi^^ i = — — "^-^LL — ^. (103) 
r(j - / - 1) ^ 

Therefore, our conjecture is right. Hence, 

= r(^). (104) 

and the i^^ diagonal entry of L, 

Wi_i,i,i = r(i)r(a + z). (105) 

Consequently, 

m 

|W„| = J]r(A;)r(a + fc), (106) 
fe=i 

which concludes this proof. 
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Appendix E 
Proof of Lemma |4] 

This proof is similar to Appendix |Dl 
By definition, 

/ r(a + l)r(6-l) ••• T{a + m)T{b-m) 

W= •.. |. (107) 

\T{a + m)T{b-m) ■■■ r(a + 2m - 1)1(6 - 2m + 1) 

The {i,jy^ entry of subject to i > j > / is of the form 

wi,ij = e^j r{a + t + j-i- i)r{b -t-j + i). (i08) 

Consequently, the multiplied factor 

= ~a 71 ■ — m\- ^^^^^ 

Oi-i,i-i,i {b-t-l + 1) 

and 



9i-i^ij {a + i + j - I - 1) 



9i-i,i-i,j 9i-i,i,i {a + i- l){b-i-j + 1) 



Supposing 



then by (|111|) we have 



k= 



(110) 



Oi-i,i-i,i (b-i-l + l) 
r{a + i+j - l-l)r{b-i-j + 1). 

Comparing the RHS of the above expression to (11081) . we get 

Oi,i,j = Oi^i^ij {a + t+j-l-l}- ^ 77 — - — 7— T (111) 

Before doing any operation on W, Oq^ij = 1. Then, by (111 II) . we obtain 

(l^iO[^±jL^. (112) 

(6 - 1) 

n (j-l)(j-2)(a + 6-l)(a + &-2)) 
{b-i){b-i-l) 



'^ (j -k){a + b-k) 



Therefore, our conjecture is right. Hence, for i >2, the i diagonal entry of the equivalent upper triangular 

u,-...^r(. + i)rwr(a + i) rc^- « + 2)r(i- « + 1) 

Consequently, 

|w| = r(a + i)r(6 - i)r™-i(a + b) 

T\Tik)Tia + h) nb-2k + mb-2k + l) (117) 
ii/^^^^^^ + ^^r(a + 6-A; + l)r(5-fc + l)' 

which concludes this proof. 
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Appendix F 
Proof of Lemma [5] 

The derivation of Lemma [5] is analogous to Appendix |Dl However, for deriving Lemma [51 we use 
Gaussian elimination by column operations from the right to the left, instead of row operations from the 
bottom to the top in Appendix |Dl After the Gaussian elimination, the left upper-diagonal triangle-matrix 
becomes a zero triangle-matrix. Consequently, the determinant of W is 



m 

m{m — 1) 



W| = (-1)^^^^ JJr(A;)r(a + A;-m). (118) 



k=l 

Appendix G 
Proof of Lemma [6] 

f{n) can be written as 

/(„) = jlp-^... r(" -'" + !-;) . („9) 

L [nj L [n — m + 1) 

We thus have 

, , fn — a n — m+l — a \ ^, , 

f{n + 1 - / n = - 1 f{n). (120) 

\ n n — m + 1 J 

It is seen that ^ • • • "^Xi"" < ^ •^(^) > ^- Hence, f{n + l)-f{n) < 0, i.e., f{n) is monotonically 



decreasing. 

For g{n) 



^(n + l)-^H= ((n + ir ^^--- ^ ^ -n-) /(n) 

n n — m + 1 



< 

If 



n — a 



n + 1)'^™ - n 



n 

n ~ a 



(121) 



f{n) 



in + 1)" < n\ (122) 



(123) 



then we have g{n + 1) — giji) < 0. 
Define a function h{x), 

h{x) = (x-a)(x + l)"-x"+^ 

= {x+iy+^ -x''^^ - {a + l){x + iy, x>a 

In terms of mean value theory ||34l , for 0(x) = there exists ^ which lets 

0'(^) = (x + 1)'^+! - x<^<x + l (124) 

where </)'(.C) is the first derivative. 
As 

(f)" {x) = a{a + l)x''-^ > 0, (125) 
(j)'{x) is monotonically increasing and thus 

0'(O<0'(a; + l). (126) 

So, h{x) < 0. 
Then, we have 



X — a / a; 



a; V X + 1 

When X = n. 



< ■ (127) 



T? — n 

(n + ir <n'^ (128) 

n 



Consequently, g{n + 1) — g{n) < 0, that is, g{n) is monotonically decreasing. 
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Appendix H 
Proof of Lemma [7] 

In terms of Euler's reflection formula 



Straightforwardly, 



I.e., 



r(i-x)r(x) = -^, (129) 

r{a + n+l)T{-a-n) = ——-^ — -, (130) 

sm (7r(a + n + 1)) 

"Tin" - '-^)"fr^- <"2) 

1 (a + 1) 1 [—a — n) 

{a + l)n = i-in-a - n)n. (133) 



Appendix I 
Proof of Theorem [3] 

From the proof of Theorem [21 we see that 

Psmv)\ 

Uk=i r(A^max -k+ i)r(iv^i„ -k + 1) 

where £(?]) is an A^min x A^min matrix of eij{riys 



Knc(^) = — :' .A!.... — ^ (134) 



1. When 2/t] G (0, \Nt - Nr \ + 1), given by ^ and Table H we have 

e,,(r/) = iV,lr(rf,, - ^). (135) 

By Lemma [31 

|E(r7)| = ATf-K;, 0, AT^i,, AT^in, AT^ax^ . (136) 

In this case, A*jj^(?7) = 2N^in/'r]. Substituting (11361 ) into (11341 ). we obtain the optimum distortion 
factor in this case in the closed form 

, , A* 't/if"? -^min; -^min; -^max) 

In the light of Lemma [6l it monotonically decreases with A^max- 

2. When 2/?] G (A^^t + A^^ - 1, cx)), in terms of ^ and Table [1 we have 

e,,(r7) = Arfrr(d,,) ^ (138) 

r ' 2 



In terms of Lemma [Hand Lemma [H the determinant of E(?7) is 

rA 



E(77) I = Ar,^-«:z ( ^, AT^in, AT^in, iV^ax ) • (139) 
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In this case, A*j^^(?7) = NtN^. Substituting (11391 ) into (I134L we obtain the optimum distortion factor 
in this case in the form 

K,,(- N ■ N ■ N ) 

n£f r(^max - k + i)r(iv^i, - A: + 1) 



3. When 2/1] E [\Nt — Nr\ + 1, Nt + Nr — 1], the analysis is relatively complex. Define a partition 
number 



+ l-\Nt-Nr 



(141) 



and partition the Hankel matrix E(?7) in (l24l) as 

E(r/) = 



A B 
C 



(142) 



where A is the / x / submatrix and C is the (A^min — /) x (A^min — submatrix. 

At high SNR, in terms of Table HI if 2/ 7^ - + 1 - |iVi - A^,.|, entries of A and C approximate 



, r(^ - rf„) ^ 
a., = iv^r(rf.,) ^r(2) p-'^ 

- 2 _2 

Cij = N;'T{dij )p V- 

7] 



(143) 



(144) 



if 2Z = - + 1 — \Nt — NJ, the form of is the same as (11441) whereas the form of aj, becomes 



iv;'iogpp", (^,j) = (/,/)• 

In terms of Schur determinant formula ||3T1| . 

|E(r/)| = |A||C- A*| 



(145) 



(146) 



where A* = B^A ^B. By the method analogous to the derivation in Appendix |Bl we know that for 
high SNR 

C - A* ~ C (147) 



where C is composed of Cjj's. Consequently, 

\E{7])\ ~ |A||C|. 

Given the preceding derivation for high and low SCBR regimes, we have 



(148) 



|A| = <^ 



if2/^^ + l-|iVi-iV, 

■/(«+Afmax-Afmin), /2 



Ki{-, I - 1, A^rnin, A^max) log P P 



-«(i + Afmax-Afmin) 



if 21 = f^ + l-\Nt- Nr 



2(A^min-0 
V 



,2 

•7] 



2(^^min-') 

Nt " -2/, Ar^i,-/,Ar^in,Ar^ax)p " . 



(149) 



(150) 
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Therefore, in this case, 

Knc(^) 



J-[^min r(Ar^,^_Z + l)r(Ar^i„-fe+l) 



2/ ^ ^ + 1 - |iVi - iV, 



r 1 1 

n atA* , K,(|,Z-l,Af„,in,Afmax)Kh(|-2Z,Afmm-«,A'min,A'max) 

PgNf ""Mogp — ^ — • 

2/ = ^ + l-|iVi-iV,| 



(151) 



where the optimum distortion exponent is 

KnM = l{l + \Nt -NA) + ~ ■ (152) 

V 

This concludes the proof of this theorem. 

Appendix J 
Proof of Theorem [5] 

Let G denote the asymptotic form of G for high SNR. Since gij is a polynomial of given by (|50l) 
and the preliminaries in Section Unl in terms of Table HI |G| can be written as J2m=i \ ^m\ where 

\Gm\ = UmP'^'-°% (153) 

i.e., they have the same degree over p~^. Each entry of Gm is a monomial of p"^ denoted by gm,ij- In terms 
of TablelHand the preliminaries in SectionHlIl we learn that gm,ii^ form is one of cr. ^"^'^a{j, r^jOp^'-'^^"*'^'"'^'' 

d—- 2 

(Form 1) and a/ ''cj log'^p (Form 2), where is a non-negative integer, e = 0, 1, and 

* r(^)r(r., + i)(rf, + i-^).^,^. ^'''^ 

c, =iv|r(rf,-^). (155) 

If the entries of first I columns of Gm are of Form 1 and other entries are of Form 2, Gm can be 
partitioned as _ 

Gm = ( Gm,l Gm,2 ) (156) 

where Gm,i is of size A^min x I and Gm,2 is of size A^min x (A^min — 0- Since Gm is a full-rank matrix, 
Gm,i and Gm,2 ought to be full rank as well. Apparently, Gm,2 is a full-rank matrix; whereas, for Gm,i, 
if there exist Tmji = ^m,j2 for ji 7^ i2, Gm,i would not be full rank, because in that case, its submatrix 
constructed by the two columns with individual indices ji and j2 would be rank-one. Thus, each Vmj 
must be distict. 

Now let us figure out /. Define a distortion exponent function as 

^n-l 7 , 2(jVmin-n) 



n = 0. 



7(^) = <! ^'^^ ' . " (15V) 



Apparently, 7(n) is on the curve of the two-order function /(x), 

f{x) =x^+(\N,- Nr\ --\x + ^ (158) 

V vj V 

which is a symmetric convex function and whose minimum value is given by x = i)_J^l^_!M 



Since n = I gives the minimum 7(72), when 2/77 G (0, |A^t — + 1), ^ = 0, Acor(^) 
when 2/7] e [Nt + AT, - 1, +00), / = N^,^, A.^M = l{Nmin) = NtNr. 
When r] e [\Nt - A^,.| + 1, Nt + N,. - 1], we should have 

7(/)<7(/-l) 

and 

7(0 < 7(^ + 1), 

which gives 

- - 1 - lA/'t - A/'J < 2/ < - + 1 - lA^t - A^J. 

V 



V 



Hence, for r] e [\Nt - Nr\ + I, Nt + Nr - 1], 

\ + l-\Nt-Nr 



and 



AL(^)=7(0 



or 



l-\Nt-Nr\ 



lil+\Nr-Nt\) + 



2{N^in - 

V 



^min<^ -,2k-l+\Nt- Nr\ 



Note that 7 



\+l-\Nt-Nr\ 



1 



k=l 

~l-\Nt-Nr\ 



This concludes the proof of this theorem. 

Appendix K 
Proof of Theorem [6] 

From the proofs of Theorem |4] and Theorem [51 we have 



cor n£fr(Ar_-fc + l)|V2(a)| 
where is defined in (1153b . 
1. Consider the case of 2/r] G (0, \Nt - Nr\ + 1). We have M = 1 and 

d —- 2 

9l,ij = "CjP"^, i = 1, . . . A^min, j = 1, . . . A^n 

where is defined in Theorem |4] and Uj is defined in (11551) . Thereby, 



N„ 



lA^t-Afrl + l- 



i=l 



So, in this case. 



/^cor(^) 



iVofcr)! 



PsNt " n.'^Trid,-! 

n£rr(iVmax-A;+i) 



n ' Knc(^)- 
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Note that Vi(cr) and V2(cr) are Vandermonde matrices defined by (|55] ) and (|54l ) respectively in the 
proof of Theorem IH 
2. Consider the case of 2/r/ G (A^t + A^, - 1, +oo). We have M = N^J. and 

gm,ij = (j;^^''a{i, rm,j)p~'^'^"'"'-' , m = l,...,M, i = l,..., N^i^, 

7 = 1 ■ 

where 



(168) 



a(j>m,j) = A^i 



r(^)r(r„,, + i)(rf, + i-^ 



(169) 



r(^-rf,)r(d, + r^j 
r(^)r(r^, + i)(rf, + i-^)._ 

By Lemma [5l 

+ 1 - ^) = (-1)'''"'^ - - ^m, ) . (170) 



Substitute (fTTOl) to (fT69l) . we have 



a{j,r^,j) = (-ir-ATf-^-- (171) 



Hence, 



Um = (-l)^^'''"'^sgn(r^)|V2(<T)| Y[ a{j,r^j] 



sgn(r^)|V2(<T)| [[Nt' 



(172) 



H 



r (^) r(r^,, + 1) 



Note that is a permutation of {0, 1, . . . , A^min — 1} and sgn(rm) denotes the signature of the 
permutation r^: +1 if is an even permutation and — 1 if is an odd permutation. 
Consequently, in the light of Leibniz formula lf3TI . 

^ |V2(ff)| 

where each entry of Q is 

. r(^ - di.) 

q., = Nt^T{d.,) . (174) 

Note that dij is defined in the description of Theorem [IJ Comparing (11741) to (11381) . we find that qij 
and eij are identical. Therefore, 

f^Uv)= U^'k^'-'-f^lnM- (175) 

k=l 

3. Consider the case of 2/r] E [\Nt — Nr\ — 1, A^t + A^^. + 1]- In terms of the proof of Theorem [5] and 
the preliminaries in Section Uni when mod {2/?] + 1 - |A^t - A^^l, 2} 7^ 0, M = /!, 

9m,ij = < 2 (176) 
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when mod {2/r/ + I - \Nt - Nr\,2} = 0, M = (l - 1)!, 

9m,, = cr7^^\-iy-%\ogpp-l, J = I; (177) 
W 'c,p-^, J>l + l. 

Note that a{j, r-mj) and Cj are given by (|154l) and (|155l) respectively; when mod {2/r]+l — \Nt — 
Nr\,2} 7^ 0, is a permutation of {0,1, ... ,1 — 1}; when mod {2/r] + l — \Nt — A^,.|, 2} = 0, 
is a permutation of {0, 1, — 2}. Thus, 



Ur 



2 



sgn(r^)|V3(a)| n;=i a{j, r^,) n^Ti N^d, - 
mod {2/r7+ 1 - \Nt-Nr\,2} ^ 0; 

sgn(r„)|V3(o-)|(-l)'-iiV, " logp (^^^^ 



mod {2/r7 + 1 - |A/'i - A/"^], 2} = 0. 

where each entry of Y^{(t), 



— mini 7 — 1, d,} 

v^,j=a, '\ (179) 



Comparing to the proof of Theorem [3] for the same case of rj, we have 



11A:=1 ^fc lll<m<ri<Afniin'^ " 

-^min ^ (^) 



(180) 



This concludes the proof. 



Appendix L 
Proof of Theorem [7] 

When 2/r] e (0, |iVt - A^^l + 1) or 2/?7 G {Nt + A^^ - 1, +oo), in terms of Theorem [6l straightforwardly, 

lims^l/i*or(^) = Plnciv) ■ 

Consider the case of 2/r] E [\Nt — Nr\ — 1, Nt + + I]. By Taylor expansion and Lemma [5] , the 
entries of V3(cr) 

^(-Pj-n+l)„ 

= 2^ — (^^ - 1) 

■ (181) 



n=Q 

2 



where = min{j — 1, — dj}. 

Thereby, when cr approaches a vector of ones. 



(Afmin-l)! 

|V3(cr)|= J2 (182) 



m=l 
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where the entries of V3 m(cr) 



J 1, 3 = 1; 

I's.m.ii = < (-ir™.^(p,).„ (183) 

Note that s„ = {s,„,2, • • • , Sm.jv.^ij is a permutation of {1,2,..., A^min - !}• 
The determinant of V3 „i(cr) 

|V3,„(^)| = {-iriViio- - l)|sgn(sj n Y{p,)r{k) n (184) 

where rii = In the light of Leibniz formula JSB and 

|Vi(o- - a)| = |Vi(o-)|, a = {a, . . . , a}, (185) 
|V3(cr)| can be written in the form 

N ■ 

' mm -1 

|V,W| ^ M)^-^|V,M||W| n (186) 

where W is an (A^min — 1) x (A^min — 1) matrix with entries 

Wij = T{i + pj+i) 

'^{i + j), ]<l-^ (187) 

r(^-|iv,-iv,|-n-z-j), j>i. 

By partial Gaussian elimination, W can be transformed to W' with a (A^min — /) x (/ — 1) left-lower 
submatrix of zeros. Partition W as 

- ( w; wO ' 

where W3 is the submatrix of zeros, the entries of are 

w[^,^ = T{i+j-l), l<2,i</-l, (189) 

and the entries of W4 are 

w',,, = {-- \Nt - iV.I -J-l] r(- -\N,-Nr\-l + i- j), 

Ji-1 V (190) 

I <hj < ^min - 1- 

|W| = |Wi||W4| (191) 
i-i 

|W;| = JJr(A;)r(A: + l). (192) 

k=l 



By Lemma [H 



By Lemma |5l 

-^min 1 / r) \ -^min~^ c\ 

|W;| = (-1)"^ n [--\Nt-Nr\-j-l] n r(A;)r(--Ar^ax + A:). (193) 
j=i J i-i k=i ^ 



28 



Consequently, in terms of Theorem [6l 



s^i'^"' ^ ' ^J-^ T^-\Nt-Nr\-k-2l + l) 

T(\N,-Nr\-'- + l + k) ^ 
T{\Nt-Nr\-^ + 2l + k) ^""'^ 



(194) 



where ^3 = "^^ . Since for any function f{x) 



n f{a + N^,^-k-l + l)= II f{a + k') (195) 

k=i k'=i 



where k' = A^min — k — I + 1, 



S-s>I 

By Lemma [5l 



- - iV^ax + A; - A = (-1)' f iV„,ax - - - A; + 1 ) (197) 



Thus, 

where n4 = l{N^in — / + 1). As 



hm nlM = (_i)ni+n.+"3+n4 ^*^^(^)_ (198) 

S-i>I 



j^_]^yn.i+ri2+n3+™4 _ ^_]^y«i-n2+n.3+»^4 _ (199) 

we have 



This concludes the proof. 



lim M*or(^) = Knc(^)- (200) 
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